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Tucker has formulated the Duality Theorem of Linear Programming in terms of orthogonality 
properties of a pair of complementary orthogonal linear manifolds with respect to the positive orthant. 
This theorem is generalized by substituting complementary polar conical sets for complementary 
orthogonal linear manifolds, and the generalization is proved under simple stability assumptions. 
Equivalence to FenchePs Duality Theorem for conjugate convex functions is established. There are 
strong parallelisms to work by Kretschmer. 
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1. Introduction 

Two linear manifolds M and N in R" are called orthogonal, if (X\ — X->) T (Y\ — Y-i) = holds 
wheneverZi , X 2 eM and Y\ , Y>eN . They are called complementary orthogonal, if they are orthogonal, 
if their intersection is of dimension zero, and if their dimensions add up to /?. 

The following formulation of the duality theorem of Linear Programming; has been given by 
Tucker [l]: 1 

THEOREM M: Suppose M and N are complementary orthogonal linear manifolds both of which 
meet the nonnegative orthant K^. Then there exist two nonnegative vectors U and V such that 
UcM, VeN, and U T V = 0(fig. 1). 




Kk;i RE 1. Orthogonal solutions U, V for complementary orthogonal 

manifolds M, IN. 



* An invited paper. 
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The purpose of this paper is to extend the above theorem to pairs of "complementary polar 
conical sets." 

We say that two sets F and G are 

complementary polar conical sets, 

if F = P-\-C and G = Q + C p for some points P 9 Q, and some cone C with C=C PI) . Here C p denotes 
the (negative) polar of the cone C, i.e., 

Cp={Y\ Y t X ^ for all XeC}. 

We want to consider the existence of nonnegative vectors U and V such that UeF, VeG, and 
U T V= 0, where F and G are complementary polar conical sets. This statement generalizes Theorem 
M, since each pair of complementary orthogonal manifolds is also a pair of complementary polar 
conical sets (fig. 2). Carrying the generalization of Theorem M still further, we drop the nonnegativity 
hypothesis for U and V and require instead that 

UeK, Ve-Kp 
for some given (closed) cone K (fig. 3). 





Figure 2. Orthogonal solutions U, V for complementary polar Figure 3. Orthogonal solutions U, V for complementary polar 
conical sets F, G with respect to R|L conical sets F, G with respect to cones K, — K p . 



In the case of manifolds, the vectors U and V are usually unique, whereas they are typically 
not unique in all other cases. Therefore we require in addition that the vectors U — P and V—Q 
be orthogonal — a condition satisfied in the case of manifolds. We say that U and V form a pair of 

orthogonal solutions 

of the complementary polar sets F and G with respect to the cone K. 

It would appear natural to generalize even further by adding points P\ Q' to K and—K p , 
respectively. Orthogonal solutions would then be defined as satisfying 

U€{P + C)n(P'+K), Ve(Q + CP)Ci(Q'-KP) 

(U-P) T (V-Q)=0={U-P') r {V-Q'). 
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However, the linear transformations U: = U 
this case immediately to 



P\ V:=V-Q', P: = P-P', Q : = Q-Q f reduce 



Ue(P+C)nK, Ve(Q + CP)n(-K*) 9 

(D-P) T (V-Q)=0=U T V. 

Therefore it is no restriction of generality to assume P' = Q' = 0, and this will be done throughout 
this paper. 

2. Propositions 

The first extension of Theorem M concerns the special class of polyhedral conical sets, that is, 
conical sets that are intersections of finitely many closed halfspaces. If F = P + C is such a conical 
set, then so is G = Q + C p , and C = C pp . Here R may be any ordered field. 

THEOREM P: If F and G are complementary polar polyhedral conical sets both of which meet 
polyhedral cones K and — K p respectively, then F, G possess orthogonal solutions UeK, Ve — K p . 

If R is the field of real numbers, then the relation C = C l>1> characterizes closed cones. The 
following example shows that general complementary polar conical sets need not admit orthogonal 
solutions, even if both meet the nonnegative orthant K = — K P = R^. Consider 



C l(f) \~y + z ^ V* 2 +y 2 +z 2 ]- 



This is a circular cone with an opening angle of 90°. Clearly C f) = — C. (moose P = Q= (1, 0, 0) 7 . 
Then (fig. 4) 




FIGURE 4. Example for nonexistence of orthogonal solutions: Two 
circular cones with angle of 90° at apex, meeting the positive 
orthant in two rays F and i\. 
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Fn/^'={P + <9(0, 0, l) 7 ' I 0^0} 
G DR£ = {Q + 6(Q 9 1, O) 7 '|0 2*O} 

and these sets have no orthogonal points in common. 

Thus we need additional conditions in order to extend Theorem M to general conical sets in 
the real space R". 

A point D of a closed cone C is called 

stable in C 

if the conical hull ^{C U (— D)) is again closed. 

If D lies in the relative interior of C, which we shall denote by C 7 , thenZ) is stable in C. Indeed, 

D=J£Am 
i-l 

where A,eC, u, > 0, and k = dimJ^(C), where oSf(C) denotes the linear hull of C. Thus A\, . . ., 
A k9 ~D span positively the linear hull of C. If therefore DeC then V(C U (- D)) = 3f(C), and 
linear subspaces of R" are closed. 

If D belongs to a polyhedral cone C, then ^(C U (— D) ) is again a polyhedral cone and therefore 
closed. Thus every point of a polyhedral cone C is stable in C. 

Further we need the notion of a 

direction of infinity. 

Vector D is a direction of infinity of F with respect to Q, and vector E a direction of infinity of G 
with respect to P, F 

(i) DeK, Ee-K» 

(ii) DeC, EeC» (1) 

(iii) D T Q = 0, P T E = Q, 

respectively. Zero vectors are included in this definition, since this will simplify statements later on. 
The name "directions of infinity" has been prompted by the following fact: 

If U, V are orthogonal solutions o/F, G, then so are U+ 0D, V + rE/br all 0, r ^ 0. (2) 

Indeed, (l.ii) and (l.iii) imply in view of polarity: 

D T V = D T (V-Q)^0/ora// VeG 

(3) 
U T E = (U- P) T E ^ for all UeF. 

From (Li) one obtains again in view of polarity: 

D T V = D T (V- Q) = 0for all VeG n - K" 

(4) 
U T E=(U-P) T E=0 for all UeF n K. 

Finally, since E+QeG D -K p , 

D T E = 0. (5) 

Proposition (2) now follows from (4) and (5): {U+6D) t (V+t£)=U t V=Q 9 (U + 6D-P) t {V+tE-Q) 
= (U-P) T (V-Q)=0. U+6DeF fl K and V+rEeG D -K» is plain, as DeC H K andfeC'Tl -K*. 
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We are now able to formulate the general 

THEOREM S: Suppose F = P-}-C and G= Q + C p are a pair of complementary polar sets. lj V and 
i\ both meet the closed cones K and— K p respectively, and if all 2 directions of infinity of V are 
stable in C and K, while all directions of infinity ofG are stable in C p and — K p , then F, G possess 
orthogonal solutions UeK, We — K p . 

Let Jt (S) denote the affine hull of a set SQR" and let S 1 stand for the interior of S with respect 
to the relative topology in M(S). We call S 1 the relative interior of S. Then we have as a corollary 
to Theorem S: 

THEOREM I: If F and G are complementary polar conical sets in the real space R n , and if 
F l C]K l 7^ 0, G'fl (— K 1 ') 1 ^ 0, then F and G possess orthogonal solutions UeK, Ve — K p . 

This follows immediately from the following 
LEMMA: // G l f) (— K p ) l # 0, then — DeC (IK holds for every direction of infinity D of F = P + C. 
Proof: By (3), the plane H={X\ D T X = 0} is a supporting plane of G. Since G 1 C\ {-K l> ) 1 ^ 
by hypothesis and H D G H (— *>) by (4), we have H H G 7 ^ and // H (— KP) l 7^ 0. Any supporting 
plane of a convex set S which meets the relative interior S 1 must contain S. Hence H~DG and 
//D —K 1 '. In view of (l.iii) we have H"DG — Q=C P . This is equivalent to —DeC. — DeK follows 
from // = -// D A". - J 

Theorem P for the real space R" also follows from Theorem S. Indeed, if C and /< are polyhedral 
cones, they have a finite number of generators, as have C 1 ' and — K p . But then so have ^f (CU {— D} ) , 
%(KU {-#}), %(C*>\J {-£}), ^(~^U {-£}), which are therefore again polyhedral cones 
and therefore closed, no matter what /) and E are selected. 

3. Uniqueness 

Let us briefly examine the uniqueness of orthogonal solutions U, V, however only in the 
case K = — K f) = R$. If there exists an index i such that Uj = Vj = Q, we say that U and V have a com- 
mon zero. In the case of manifolds, there is a known result: 

THEOREM U: Orthogonal solutions with a common zero exist if and only if the orthogonal solutions 
are not unique. 

The "only if" part of Theorem U is commonly deduced from the following statement: 
THEOREM V: If complementary orthogonal manifolds M, N possess orthogonal solutions at all, 
then they possess orthogonal solutions without a common zero. 

The analogous statements for complementary polar conical sets do not hold. Consider for 
example the following polyhedral conical sets: 

Jt + y ^ 3, x — y-\- z ^ 1, — x-\-y-\- z^ l\ 




* + y^3,-*-hy+2z^2, x-y+2z^2Y. 
The above two sets are complementary polar, with P = Q= {i,i, l) 7 . The orthogonal solutions are 



2 It will become apparent from the proof of Theorem S, that it suffices i<> require that there exists at least one stable direction in the relative interior of the cone of 
directions of infinity. 

•'The horizontal bar at the end of a paragraph marks termination of a proof. 
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They are not unique in spite of the absence of common zeros. Thus the "if" part of Theorem U 
is not valid for complementary polar conical sets. 

As a counterexample for Theorem V consider the conical sets: 

F - c 4i 



-y + z^ V^ 2 -hy 2 + z 2 k G = Cv.=-C. K = -Kp^=i 



Here F D R$ and G D B$ are the nonnegative parts of the z axis and they axis, respectively. Hence 
x = for all UeF H /^" and VeG PI R$ l . Note that in this example the existence of orthogonal solutions 
cannot be inferred from Theorem S. 

4. Proofs 

We proceed to prove Theorem P. The proof of Theorem S will then be based on Theorem P. 

PROOF OF THEOREM P: Let UeK, Ve — KP be vectors in F, G respectively. By the definition of 
the polar (U-P) T (V-Q) ^ as well as U T V^0. Thus 

U T V- (U-P) T (V-Q) = U T Q + P T V-P T Q ^ (6) 

for UeF n K and VeG n (-A>), and 

U T Q + P T V-P T Q = 

is necessary and sufficient for U T V=0 and (U — P) T (V—Q) = to hold simultaneously. The 
existence of a pair of orthogonal solutions U and V is therefore equivalent to the following linear 
program having an optimal value of zero: 

Minimize U T Q + P T Y - P T Q over U, V subject to (7) 

UeP+C, UeK 
VeQ+C'\ Ve-K»\ 

Program (7) is separable: The pair U, V is an optimal solution of (7) if and only if U and V are 
optimal solutions of the following two programs respectively: 

Minimize U T Q over U subject to (8) 

UeP+C, UeK, 
and 

Minimize P T V — P T Q over V subject to 

VeQ+C»\ Ve-K<\ (9) 

By hypothesis, C and K are polyhedral cones 

C={S\A T S^0},K={BZ\Z^0} 
C»= {AT\T ^ 0} , - K*>= {JV\B T W ^ 0}. 

One has U = BZ = P + S with Z ^ 0, /FS ^ 0, and V=Q+AT with 7^0, fi r F^0. In terms of 
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Z and 7'the programs (8) and (9) thus reduce to 

Minimize Z T B T Q with Z subject to 

-A T BZ^-A T P (10) 

Z^O. 

Maximize — P'AT with T subject to 

-B'AT^B T Q (11) 

T^O. 

The programs (10) and (11) are clearly duals of each other. The duality theorem of linear 
programming then gives Z T B r Q = — P T AT or 

U T Q + P T V-P T Q = 0, 

as U T = Z T B T and AT=V—Q, for optimal solutions Z and 7 of programs (10) and (11), respectively. 
The existence of optimal solutions follows from the hypothesis, that F and G meet K and — K l \ 
respectively, and that therefore feasible solutions to both programs exist.— 

PROOF OF THEOREM S: Let D F be the set of all directions of infinity of F = P+C, and similarly 
let D (; be the set of all directions of infinity of G = Q + C 1 '. Plainly, D F and D (; are closed convex 
cones. Moreover, by the stability hypothesis of Theorem S, 

the four cones (12) 

%(CU-D F )=C-D F = C + L F ,L F ; = &(D F )=D F -D F , 

<g(K U -D F )=K-D F =K+L F , 
%(-KP\J-D G )=-Kt>-D G =-K*>+L G 

are closed. 

To see, for instance that C + L F is closed, let D {) be any point in the relative interior D l v of D F . 
Then tf{D F U {-D })=L F and therefore C + L F = tf(C U {~D }). The latter cone is closed 
since Z) is stable by hypothesis.— 

Next we show that without loss of generality, we may assume that 

C D KDL F and C*> fl (-K*>) D L (; . (13) 

To prove this we shall use on several occasions the following simple lemma whose verification is 
left to the reader: 

Let L be a linear manifold in R n , and let A and B be any sets in R n . Then A C L implies 

A+ (B n L)= (A + B) H L. (14) 

We return to proving that (13) constitutes no restriction of generality. Suppose the pairs of 
cones C, O and K, — K l> do not satisfy (13). Then we consider the following modified pairs 

C:=(C + L F )nL£,C»:=(C»-rL (; ) HL|, 
K:=(K+L F ) nL^-K»:=(-K» + L (; ) C\L±. 

The (closed) cones C and C p are indeed polars of each other, as are K and K 1 ', since by (5), we have 

L F QLh andL G QL^ (15) 
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and (14) then gives 

C={CC)L G -)+L F , 
K=(KnLj*)+L F . 
Polarizing these equations yields in view of (12) 



Cp= (Ci> + L (; )nL£= (C» + L G )nL£ 



and finally 



KP= (K p +L a ) fU£ = (K*> + L G ) DL^ 



K p= ( _ K p_ Lc;) n _ (L ±) = (-Kp + Lc) r\Lj;. 



Next we verify that C, C p and K, — K p indeed satisfy (13). To this end we denote by C F , C G 
the cones of directions of infinity of F: = P + C, G: = Q + C P with respect to K, — K p . Let then 

DeC F QCC\K. As C+ L F = C — C F , since L F = C F — C F and C F QC, we have D = Di — D 2 where 
DieC and D 2 eC F . Similarly, D = D 3 — D 4 where D :i eK and D 4 eC F . We claim D\ + D 4 eC F . Indeed, 
(D l ^D 4 ) 1 0=(D^D 2 ^D 4 )'Q = D T Q + DlQ+D 1 4 Q = 0; D, + D 4 eC as D^C, D 4 eC F QC; D { + D 4 
= D 2 + DzeK as D 2 eC F CK, D 3 eK. Clearly, D 2 + D 4 €C F . Thus D=(D { + D 4 )- (D 2 + Z) 4 )€C F - C F =L F . 
This proves C F QL F . Now LfQCD Khy the definitions of G and K, and in view of L f QLq- (15). 
Moreover, D T Q = for every DeL F = C F — C F by (l.iii). Thus, and by an analogous argument for G, 



6V = L F and C G — L G . (16) 

This clearly implies (13) for C and L Moreover it shows that ^(GU {-/>}) = C, ^(C^U {-£}) = C p 
for all Z)eCf and EeC G . In other words, all directions in infinity of F, G are stable (the reader should 
recall at this point, that the construction of F, G did require that the original sets F, G had only 
stable directions of infinity). 
By (4), 

FClKCL^ and GO (- K p ) CL£. (17) 

Since PeL G by (l.iii), application of (14) yields 

F=P+C=P+ (C + L F )nL£=(P + C + L F )ni£. 

Hence, 

F n k= (P + C+L F ) n (K+L F ) nL&DF nKn Lt 

By (17), and an analogous argument for G, 

FnKDFnKandGD (-&) DGfl (~K p ). (18) 

This shows that if F, G meet X, — K p , respectively, thenF, G meet /£, — K p . 

Altogether, we have seen that if F, G, /£ satisfy the hypotheses of Theorem S, then so do 
F, G, /£. It remains to be shown that if F, G possess orthogonal solutions UeK, Ve — K p , then orthog- 
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onal solutions UeK, Ve — K f> of l\ G can be derived from them. As UeF = P + C — Ci ■■■ = F — Ci «•, 
there exist U\€F, l)\tCi such thai U=U\—D\. As L?eK, there exist U>eK and I)>eCi Mich that 
U = U 1 -D 1 . Then t/:= C/, +Z? 2 = tf2+Z>i belongs to F n £. Similarly, there exist F^cG, V.e-K" 
and Ex, E 2 €C G such thai F:»«Fi+£i«Fi+Ei€G fl (-£ p ). £/ and F satisfy the orthogonality 

conditions in view of (4) and (5). Hence they arc orthogonal solutions of F, G with respect to K. 
If therefore Theorem S holds for cones satisfying (13), then it holds in general. 

Consider now a pair of complementary polar conical setsF = P + C and G = Q + C l> with the 
cones C and K satisfying (13). Moreover, we suppose that F C\ K ^ and G D — K p ^ 0. Then we 
approximate C and K by increasing sequences of polyhedral cones C (A) a.ndK (k) , 



C<n c C (2) C ...CC=U C (A ' : 



(19) 



£(DCK< 2 >C . . . CK=UlV k \ 
such that for A: =1, 2, . . . and F< fc >: = P + C<*>, 

F (k) HK ik) ^ 0, (20) 

L/, C C<*> C L^,Lf C K<*> C A r |. (21) 



and 



We construct such a sequence of cones C (fc) from a sequence {X (A:) }/c=i, 2, . . . of points everywhere 
dense in C. Since F D K #0, we may assume that X^ + PeF U /v and put 

C<*>: = #{*<!>, . . ., *<*>}+L F 

Both ( €{X {X \ . . ., A" (/x) } and L/ are polyhedral cones, and the sum of two polyhedral cones is 
again polyhedral. Sequence K (k) is formed similarly. C (k) D K ik) Q C fl KC L% by (4). Thus (21) 
is satisfied. 

The sequences of the polar cones C (k),) and — K (k)l> are decreasing sequences which approxi- 
mate C l) and —K.P, respectively, 

cm,, 2 C c>)p 2 ... D e*= n C ( *>" 

(22) 
-P^D-K^D . . . D-K»=n-K {k) i\ 

and satisfy for k = 1, 2, . . . and G<*>: = <? + C ( * )p . 

G ( k ) n (_£<*)p) ^0 (23) 

and 

L G C C< *>* C L f 4 aAi^ L, ; C - K { k)l > C Z^ . (24) 

Indeed if A'eC, then there exists a sequence {A' (a " ) }a-=i j 2, . . . such that X^ k) eC^ k) and X^ k) ->X. 
For every Ye fl C<*>p and all k we have therefore F^czc) ^ 0. Hence Y'X ^ for all XeC, which 
proves YeC'\ The inclusion C ;> C Pi C (k)l> is trivial. The same argument gives —K ]J = (1 —K {k)l> . 
The properties (23) and (24) follow immediately from G ik) D G, -£(*>/> D - K*\ and L| C C {k \ 
-K {k} C Lh from polarizing (21). 

In what follows, we will replace sequences (19), and thereby sequences (22), repeatedly by 
suitable subsequences. The terms "sequences (19)" and "sequences (22)" will always refer to the 
current, and not to the original specimens. Similarly, C (A) , K^ k) will be the k\h elements of the 
sequences (19) as they stand after modifications, and U^ k) eK {k \ V^ k) e — K {k)p will always be orthog- 
onal solutions of F {k) = P-\- C (A>) , G {k) = Q + C (A)/> . Such orthogonal solutions exist by Theorem P. 
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The orthogonal solutions U {k \ V ik) are in general not uniquely determined. They can be modi- 
fied by adding arbitrary directions DeL F , EeL G respectively. Indeed DeL F , EeL G are directions of 
infinity of F (A) , G {k) with respect to K (A) , and we have seen that adding such multiples leads to'new 
orthogonal solutions. Now let Z?i, . . . , D s be a basis of L F . Then there exist multipliers ai such 
that U {k) : = U^ k) — ^aiDieL F . It follows that without restriction of generality, we may assume 

W k) eL F andV^eLi. (25) 

Now either sequences (19) can be replaced by subsequences such that the limits 

t/=lim £/<*>, F=lim^ 

exist, or | | U ik) | | -> °° or | | V {k) | | — > oo. 

Assume that | |f/ (A) | | —> °°. If sequences (19) are replaced by a suitable subsequence, then 
the sequence {U ik) l \ \ U ik) \ | }a-i, 2, . . . converges towards a direction Z), ||D|| = 1. We have 

n r U^-P v [/<*> 
D = lim 1 1 -.„. , — ^77 — 11m 1 



As C and K are closed by hypothesis, 



\U(k)-p\\ |£/(A 



DeKHC. (26) 



Select any point UeF (1) P\K. Then UeF {k) CiK {k \ and since U {k) is an optimal solution of program 
(8) over F {k) C)K {k K we have 

U^ T Q ^ U T Q for all k. 

In other words, the sequence {lfl k)T Q}k=i, 2, ... is bounded above, whence 

DT Q^^JfUO^^0. (27) 

Select any point VeG H (-£*). Then ZFF^ as De£ and Ve~K^ and D T (V-Q) ^ as DeC 
and V-QeQp. Hence Z) 7 (? ^ 0. Together with (27), this gives 

D T Q = 0. 

In other words, D is a direction of infinity of F , and 

DeL F 

by (13). On the other hand, DeL£ by (25). Thus Z> = 0, which contradicts | |jD|| = 1. Therefore 
J I if(k) J J _► 00 cannot hold. 

Assume then | | V {k) \ \ — > °°. For suitable subsequences of sequences (23), 

y(k) — n y(k) 

and 1 1 £ 1 1 = 1. Select any point VeG D (-K"). Then feG< A) fl (-£<*>*) as sequences (22) are 
decreasing. Since V {k) is an optimal solution of program (9), 

pry(k) ^ pry f or a ll k, 
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and therefore 



pryik) 

Pip= i; m - — 1 <c o 

r a Um \\V(k)\\ U ' 



It then follows as before that EeL (; , contradicting ||#|| = 1 and EeLj;. 

We may therefore assume that limits U, V exist. UeF H K and ^eG fl (— /£>), as C and /< are 
closed. l] (k)r V (k) ={U (k) — l ) ) T (V (k) — (J) =i) for all A: by orthogonality, and this carries over to 
U and F. The latter are therefore orthogonal solutions of F and G. This completes the proof of 
Theorem S. 

5. Fenchel Duality 

Fenchel [2, 3] considers the following pair of dual programs 

Minimize f (X) — g(X) 

Maximize gr(Y)-f<(Y). (28) 

Here /is a convex function f\R"-^ R U {+ 00 } and g is a concave function g\R n -> R U {— »}. It 
is convenient to consider/ and g as defined everywhere on R" and to admit infinite function values. 
The obvious interpretation is used, whenever infinite values occur in the convexity (concavity) 
conditions: 

/(XJTi + XA) *kif(X t )+knf(Xi) 

giktXi + k^) &kig(Xi)+k 2 g(X 2 ) 

for all Xi, X2 ^ with k\ J r\>> = 1. The following "domains of finiteness" 

K(f) : = {XeR«\f(X) < + *>}, K(g) : = {XeR*\g(X) >-«} 

are convex under these circumstances. 

The function / c is the "convex conjugate" of/, and the function g c the "concave conjugate" 
of g. They are defined by 

f{Y) : = sup (F-jf-/(X)),r(I0 : = inf{ra-tf(A)}. 

A' A 

From this definition, 

/'(F) 3* ra-/(A), ^(F) *£ F'X-^(Z) 
and therefore 

/(Z)-g(A)^^(F)-/c(F) 

for arbitrary X, YeR n . In other words, 

inf (f(X) -g(X)) 2* sup (gc(Y) -f ■(¥)). 

X Y 

The question examined by Daulity Theory is under which circumstances inf = sup, or stronger, 
min=max. The conditions 

K(f) n K(g) 7^ and K(f<) H K(g c ) ^ (29) 

are obviously necessary for min=max to hold. Another, in general necessary, condition is that 
the functions 

f and g are "closed", (30) 
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that is, lower semicontinuous convex and upper semicontinuous concave, respectively. In this 
case, f cc =f and g cc = g. 

Except for polyhedral functions, hypotheses (29) and (30) are not sufficient for min = max, 
not even for inf = sup to hold. So-called "duality gaps" may occur, as first communicated by Stoer 
in a letter to Karlin. The stronger hypotheses, 



KifyPlKig) 1 * andKif?) 1 H K(g ( ') r ^ 0, 



(31) 



together with (30) ensure min^ max in the general case. Rockafellar [5] and Stoer [6, 7] investigated 
"stability" hypotheses weaker than (31) but stronger than (29), for which min = max or inf = sup 
obtains. 

This situation is analogous to the one examined in this paper: Theorem P holds for polyhedral 
cones but not in general. Theorem I holds in general but is too weak to yield Theorem P in the special 
case of polyhedral cones. Theorem S finally gives a general result subject to stability conditions. 
One is therefore lead to expect a relationship between Fenchel's Duality theorem and Theorem S. 
We proceed to show that they are in fact equivalent. More precisely, we prove: 
THEOREM E: For each triple F=P+C,G = Q + C P , K, where C, K are arbitrary closed cones and 
P, Q arbitrary points, there exist closed functions f and g, convex and concave respectively, such 
that F, G have orthogonal solutions UeK, Ve — K p if and only if min = max for the corresponding 
programs (28), and vice versa, for each pair of such closed functions f, g there exists a triple F, G, K 
such that again equivalence holds between the statement min = max and the existence of orthogonal 
solutions. 

PROOF: Given a triple {F = P + C, G = Q + C»,K), define 



Then 



f(X):- 
g(X):- 



Q'X for XeK 
30 otherwise 

for XeP + C 
— oo otherwise. 



f<(Y) = sup (r-X-f(X))= S uj>(Y-Q) T X- 



Putting Z :=X — P, one has similarly 



for YeQ + KP 

00 otherwise. 



g c (Y)=M{Y T X-g(X))= inf Y T X=Y T P + inf Y T Z, 



and therefore 



Programs (28) then become 



g c (Y)- 



Y T P\{Ye-C» 
— oo otherwise. 



Minimize Q T X with X subject to 

Xe(P+C) n K 

Maximize Y T P with Y subject to 

Ye(Q+K") n (-C") 
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Substituting U : = X, V : = Q — Y, and transforming the maximization program into a minimization 
program yields programs (8) and (9), and it has been shown that the existenee of orthogonal solu- 
tions is equivalent to inin-f min=0 for these programs. 

In order to prove the converse direction, we transform the minimization program (28) into 



Introducing the cones 



and the linear subspace 



we formulate program 



Minimize zj — Z2 with Zi, z 2 , X subject to 
z,>f(X),z 2 =Sg(X). 



C f : = V 



C(, : — to 



X 

z, 

X 



z\\z*>f(X) 



x \h 



g(X) 



\z u z- 2 eR,XeR» 



Minimize z\ ■*- 7.2 subject to 



{■■V2) 



(33) 



X" 

Z\ 

h 
X, 

Z-l 

ti 



€(C/XC g ) n 












1 



+ L 











_1_ 





We proceed to prove, that 

programs (32) and (33) are equivalent. 



(34) 



(35) 



We have to show, that if (zi, Z2, X) is a feasible solution of (32), then (t\ = 1, t> = 1, Zi, 22, X\=X, 
X->=X) is a feasible solution of (33), and vice versa. 

For an auxiliary argument, consider any closed convex setK \nR k \ and the convex cone 

Then H(K) is not necessarily closed. However, H(K) and H(K) differ only in points ( ) with 
VW 

in) \ / W \ 

W l\w) 



w=0. Indeed, let 



Win) 



he a convergent sequence of nonzero elements of H(K), i.e., W {n) lw {u) eK. If w > 0, then 
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W tn)j w in)-> WjweK as K is closed. But then ( W \ eH(K). Thus only if w=0 may ( W \ be in 

H(K) but not in H(K). 

As the functions/ and g are closed, so are the convex sets 



The above argument can therefore be employed to show that 

(CfXC g ) n T=(C f xc 9 ) nr, 

where 7 1 denotes the plane characterized by t\ = t 2 = 1. In the expression (34) for the feasible 
region of (33), one can then replace (C/X C g ) by (C/X C$) D F, (C/X C g ) HT and (CfXC g "} 
successively, without changing the set. It is then plain that the points in (34) correspond to the 
feasible solutions of (32). 

Program (33) is oj type (8). 

The product C/X C u plays the role of K, and the linear subspace L plays the role of C. Furthermore 



Q= 



r °n 




rcn 


i 











,p= 


i 




-i 







_ 0_ 




_i_ 



We have to show, that the corresponding program (9), 

Minimize wi + W2 subject to 



Si 

W\ 

Y 2 

52 



e-(CfXC g )p n 





"0" 

1 









+/> 











-1 






LoJ 


, . 



(36) 



is indeed equivalent to the maximization program (28). To this end, we note that 



Z> = 



-r 



W\ 

Y 





\w u w 2 eR, YeR" 



All feasible solutions of program (36) are therefore necessarily of the form 
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-Y 
1 

W\ 

Y 
-1 
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These points must moreover belong to - (C/X C 7 )/\ As (C f XC g )P= (C f XC g )P= (CfXCg)**, 
all feasible solutions are characterized by 

— y 7 'Z + zi + w\ ^ and Y T X—Z2 + W2 ^ whenever z\ ^f(X) and z>i ^ #(Z), 

in addition to being of the form (37). These conditions are clearly equivalent to 

-Y T X+f{X)+Wi ^OforallXeR" 
and 

Y T X-g(X) + ^2 ^ 0/or a// *efl», 

respectively. These in turn are equivalent to 

wi ^ f c (Y) and w 2 ^-g c (Y). 

Minimize f<(Y)-g<(Y) 
Maximize g c (Y) —f c (K), 



Hence program (36) becomes 



or 



which was to be shown. — 
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